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The Parisi formula for the free energy of the Sherrington-Kirkpatrick model is completed to a 
closed-form generating functional. We first find an integral representation for a solution of the Parisi 
differential equation and represent the free energy as a functional of order parameters. Then we set 
stationarity equations for local maxima of the free energy determining the order-parameter function 
on interval [0, 1]. Finally we show without resorting to the replica trick that the solution of the 
stationarity equations leads to a marginally stable thermodynamic state. 
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Interest of physicists in spin glasses has nor been abat- 
ing during last few decades. In spite of a tremendous 
progress in understanding of, in particular, the mean- 
field theory of spin glasses achieved in recent years, an- 
swers to a number of questions about physical proper- 
ties of spin-glass models have not yet been found with 
ultimate validity. Although presently the major theoret- 
ical effort concentrates on clarifying the relevance of the 
mean-field solution for finite-dimensional systems, there 
still remain unresolved issues on the mean-field level. 

The paragon mean-field theory for spin glasses is pro- 
vided by the Sherrington-Kirkpatrick (SK) model intro- 
duced more than thirty years ago [lj]. It took only a 
few years before Parisi inferred by a specific ansatz the 
form of a consistent solution of this model 0]. Parisi's 
solution, however, did not mark the end but rather the 
beginning of interest of theorists in spin-glass systems. 
There were two major reasons for further investigations 
of properties of the SK model and the Parisi solution. 
First, although most of the properties of the Parisi so- 
lution indicated that it is the exact solution of the SK 
model, no mathematical proof existed in that time. Sec- 
ond, the Parisi solution was derived via the formal replica 
trick and the order parameters necessary for its descrip- 
tion were constructed from non-measurable mathemati- 
cal objects. The proper physical meaning of the replica- 
symmetry breaking (RSB) in the spin-glass phase was 
initially unclear. 

The principal breakthrough in the proof of the exact- 
ness of the Parisi solution was achieved only a few years 
ago by Guerra and Talagrand 0, HI- They succeeded 
in proving rigorously that the replica-symmetry scheme 
of Parisi represents simultaneously both a lower as well 
as an upper bound on the free energy of the SK model 
in the thermodynamic limit. The existence of the ther- 
modynamic limit with the self-averaging property of the 
free energy had already been proved earlier Unfor- 
tunately, neither the Parisi formula for the free energy 
nor the construction of Guerra and Talagrand do pro- 
vide equations determining uniquely the thermodynamic 
state in the spin-glass phase. Although Talagrand con- 



jectures the existence of a unique macroscopic state @ , 
the Parisi free energy is expressed only in a loose form of 
a formal maximum in a large functional space of order- 
parameter functions. The way how to approach practi- 
cally the maximum and how does the order-parameter 
function look like remain presently unset. Moreover, not 
having an explicit representation for the free energy sta- 
tionary with respect to (w.r.t.) order parameters, it is 
not straightforward to define physical quantities such as 
magnetic susceptibility, entropy or specific heat. 

The aim of this Letter is to extend the Parisi expres- 
sion for the free energy of the SK model to an explicit 
closed-form functional of the order parameters. Maxi- 
mizing the free energy, unspecified in the Parisi formula- 
tion, will then become a uniquely defined process of find- 
ing solutions to stationarity equations determining fully 
the actual form and values of all order parameters. The 
Parisi free energy extended in this way becomes a func- 
tional containing the entire physical information and gen- 
erating all physical quantities via (functional) derivatives 
without referring to the replica trick and mathematical 
replicas. Moreover, our formulation of the mean-field free 
energy opens a way to systematic expansions and non- 
perturbative approximations to physical quantities in the 
low-temperature spin-glass phase. 

Using the replica trick, Parisi expressed the free en- 
ergy of the SK model as a functional of the order 
parameter function q(x) for x G [0, 1] generalizing 
the single Sherrington-Kirkpatrick order parameter q = 
N^ 1 mf , where m, are local magnetizations. The free 
energy density in the Parisi solution is then expressed as 
1 
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where we used an abbreviation for a Gaussian differential 
Vrj = dr] e-^^/V^TT- The most difficult "interacting" 
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part of the above free energy f(x, h) is not known ex- 
plicitly. It is merely characterized by a Parisi differential 
equation with an initial condition 
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the physical functional must obey. The physical solution 
for the free energy should then be constructed by pick- 
ing up the function q(x), being nondecreasing on interval 
[0,1], so that functional f(x,h) obeying Eq. @ maxi- 
mizes the free energy from Eq. ([1]). We, however, do not 
know whether the maximizing order-parameter function 
q(x) obeys a specific equation and if yes, how does the 
equation look like. 

We can gain some insight into the phase space of the 
order-parameter functions from the Guerra and Tala- 
grand construction. It relies on the so-called discrete 
replica-symmetry breaking scheme. The latter can be de- 
rived straightforwardly from demanding thermodynamic 
homogeneity of the resulting free energy. Thermody- 
namic homogeneity is tested by stability of free energies 
with replicated spin systems w.r.t. a weak interaction be- 
tween the replicated spins 0. We replicate the original 
system so many times until we reach thermodynamic ho- 
mogeneity, that is, independence of a further replication. 
In this way a hierarchical structure of free energy emerges 
due to successive replications of the original system. The 
averaged free energy density with K hierarchies can then 
be represented as a functional of local response functions 
to the inter-replica interaction [7( 
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We used a sequence of partition functions 

-i l /mi 



Zi = 



V *l-i 



the initial condition for which reads 



(3b) 



We again dc- 



Z a = cosh [/? [h + vVv + Eti x i VWi; 
noted the Gaussian differential T>\ introduced in Eq. fl} . 
The order parameter q is the only one directly connected 
with local magnetizations. The other ones, 1 > A%i > 
A%2 > ■ ■ • Axk > and 1 > mi > m-i > . . . > were 
introduced due to an induced interaction between repli- 
cated spins. All the order parameters are determined 
from stationarity equations locally maximizing free en- 
ergy ([3]). The number of hierarchies K is not an order 



parameter characterizing a saddle point of the free en- 
ergy. It is fixed from stability conditions, that is, it is 
a number of steps needed for achieving thermodynamic 
homogeneity Q. 

It was actually the discrete form of the replica- 
symmetry breaking that was used by Guerra and Tala- 
grand to prove its exactness for the free energy of the SK 
model. They proved that free energy ([3]) becomes exact 
for the set of pairs {mi, Axi, m.2, A^2, • • • , tuk, Axk} 
for which it is maximal. It is not specified whether the 
set is finite or infinite, how the parameters should be dis- 
tributed on the underlying interval [0, 1], or whether they 
obey specific (stationarity) equations. The extremum 
may well become a supremum reached only at the bound- 
ary of the multidimensional phase space. 

It is important to realize that the discrete free energy, 
Eq. |3j), and the continuous one, Eqs. fl]) and ([2]), are 
not identical. First, the former has two sets of order pa- 
rameters to/ and A\i for I — 1, . . . , K while the latter 
only one, q{x) for x £ [0, 1]. Second, the order parame- 
ters from the discrete hierarchical free energy are deter- 
mined from stationarity equations unlike the Parisi free 
energy, where the equation for q{x) is unknown. Third, 
the discrete free energy generally does not obey the Parisi 
differential equation |2]). In fact, the Parisi free energy 
emerges from a specific limit of the discrete ones, namely 
when K — > oo, Axi = Ax/K — * dx, and we neglect 
second and higher powers of Axi with the fixed index I 
0. 

Parisi's solution is defined on a subclass of measures 
considered by Guerra and Talagrand on which we look for 
a maximum (supremum). It seems that at least for the 
SK model, continuous of the Parisis solution measures 
form a complete space and the Parisi free energy deter- 
mines the exact, marginally stable solution. We demon- 
strated it explicitly in the asymptotic region below the 
critical temperature of the spin-glass phase in zero mag- 
netic field [8(. On the other hand, there are models, such 
as the Potts spin glass [§] , where a discrete one-step RSB 
appears to be stable on a finite temperature interval [Io| . 

We demonstrate in this Letter that independently of 
where the absolute maximum of the RSB free energy may 
lie, we can always construct a solution with a continu- 
ous distribution of differences Axi and a single order- 
parameter function to(A) on the defining interval [0, 1] 
determined from an explicit equation for a local maxi- 
mum of the free energy. 

To formulate the continuous free energy and to fix 
and 1 as ends of the underlying interval on which the 
order-parameter function is defined we introduce two 
physical order parameters q and X. The former corre- 
sponds to q(0) and the latter to q(l)—q(0) in the Parisi so- 
lution. We do not use the sequence 1 > mi, > . . . m,K > 
to set the interval on which the order-parameter function 
is defined as in Eq. (TT|) . We find it more convenient to re- 
verse the choice and use Axi = XdX as the fundamental 
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infinitesimal differential. Neglecting all higher than lin- 
ear powers of unless accompanied by a compensat- 
ing summation over the labeling indices, free energy © 
reduces to 

f(q,X; m(A)) = -|(1 - q - X) 2 - ± In 2 
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where (X(rj)) v — J^° oo 'DriX(rj). The principal achieve- 
ment of this Letter is an explicit integral representa- 
tion of the interacting free energy g(l,h). Dropping all 
terms of order 0(d\ 2 ) in the discrete hierarchy of par- 
tition sums Zi in the continuous limit K — > 00 with 
Axi = A\/K = XdX we finally obtain 

g(l,h)=E (X,h;l,0)og (h) 



Tacx P || J dX[d 2 h 



+m(X)g'(X;h + h)d- h ]}g (h + h) 



(5) 



h=0 



where we used prime to denote a derivative w.r.t. the 
magnetic field h, g'(X,h) = dhg(X,h). To reach a 
closed form for the continuous free energy we introduced 
a "time-ordering" operator T\ ordering products of A- 
dependent non-commuting operators from left to right in 
a A-decreasing succession. The time-ordered exponential 
is then defined as 



T\ exp <^ / dXO(X) } = 1 



]T / dXi dX 



Jo 



a ... f " 1 dx n d(x 1 )...d(x n ) 
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Time-ordering operators are a standard tool in represent- 
ing quantum many-body perturbation expansions. The 
initial condition for the A-evolution in Eq. ([5]) is the local 
free energy go(h) = In [cosh f3h] . Unlike the Parisi con- 
struction we develop the solution on the defining interval 
from zero to one. 

It is straightforward to verify that the interacting part 
of the free energy g(X, h) obeys a Parisi-like equation 



dg(X,h) 
dX 



X 

y 



d 2 g(X,h) 
dh 2 



+ m(A) 



( dg{X,h) 
\ dh 



(6) 



The opposite overall sign of the r.h.s. of this equation 
compared with Eq. ([2]) is connected with the reverted 
evolution of the initial condition used here. 

Evolution operator Eo(X; contains only polyno- 
mials in powers of derivatives w.r.t. an auxiliary mag- 
netic field replacing the Gaussian integration over auxil- 



iary random fields A; in Eq. ([3]). It is, however, a non- 
linear operator that is why we must find analogous in- 
tegral representations for functions g'(X,h) and g"(X,h) 
appearing in Eq. ©. 

From the definition of the evolution operator Eo we 
obtain 



dg(X,h) 



dh 



X 



= m (X,h;X,0)og' (h) 
dv m(u)E (X, h; A, v) o [g'{v, h)d h g'{v, h)] 



(7) 



A solution to this integral equation can again be repre- 
sented via an evolution operator and the T-ordered ex- 
ponential 



<7>, h)=E(X,h;u,0)og' (h) 
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h=0 



Analogously we derive an evolution operator for the sec- 
ond derivative of the free energy 



g"[y, h)=E 2 (X,h;l,0)og'J ] (h) 



Txcxp^X I dX 
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-m{X)d Tl g'{X ] h + h)\}g l l {h + h) 



h=0 



(9) 



Having an explicit representation for the free energy 
we can derive stationarity equations for its local extrema. 
Free energy f(q, X; m(X)) is a function of static parame- 
ters q and X and a nonlinear functional of the dynamical 
order-parameter function m(A). Vanishing of the free en- 
ergy w.r.t. infinitesimal variations the static parameters 
leads to the following equations 



q 

X 



1 

^2 



(E(X, h v ; 1, 0) o g'oihrj) 2 )^ 



(10a) 



(10b) 



We denoted h v = h + t]^fq. Vanishing of the free energy 
w.r.t. infinitesimal variations of function m(A) leads to 
a functional equation 



A 



(3 2 X 



(E(X,h v ;l,0)og' (h v ) 2 ) r 



(E(X,h ri ;l,X)og'(X,h ri ) 2 ) i ] (10c) 
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valid for any A E [0, 1]. Notice that Eq. (fTOcf for A = 
is trivial and for A = 1 coincides with Eq. (|10b|) . Hence, 
only equations for < A < 1 serve for the determination 
of m as a function of the evolution parameter A. 

Free energy complemented with stationarity equa- 
tions pop defines a thermodynamic state of the SK model 
for all input parameters. It is thermodynamically consis- 
tent so that physical values of all internal parameters 
specifying the thermodynamic state are determined self- 
consistently from stationarity equations and the standard 
thermodynamic relations hold. For instance, magnetic 
susceptibility reads 



1 



XT = ^{g"{l,h + r ]y fq)) n . 



(11) 



We do not have an integral representation such as in the 
Parisi formulation [2|, since we do not use q(x) as the 
order-parameter function but rather m(A). Nevertheless, 
we have an alternative implicit representation of g"(X, h) 
in Eq. ([9]). It is, however, important that we do not 
need to resort to the replica trick to define and calculate 
physical quantities in the thermodynamic state described 
by free energy Q. 

One of the attractive features of the presented exten- 
sion of the Parisi free energy is a possibility to verify sta- 
bility of the solution of equations (fTOf . To this purpose 
we utilize the fact that Eq. (jlOcjl holds for all A 6 [0, 1]. 
Then also a total derivative of both sides w.r.t. A must 
be equal. Employing properties of the evolution operator 
E we find 



dX 



E(X,h;l,X)o g'(X,hy 



= -XE(X,h;l,X)o g"(X,h) 2 . (12) 



Using this result in Eq. (|10c|) we obtain a generalization 
of the de Almeida-Thouless condition rjj for marginal 
thermodynamic stability 



f3 2 = (E(X,h r ,;l,X)og"(X,h ri ) 2 ) 7 



(13) 



It is actually a functional equation for A e [0, 1]. With 
some effort we can verify that Eq. (|13[) is a continuous 
limit of stability conditions derived in [7|,|l_2|. We see that 
the Parisi solution of the SK model satisfying Eqs. (fTU|) 
is marginally stable with no negative eigenvalues of the 
nonlocal susceptibility or the spin-glass susceptibility. 

Free energy @ with the interacting part from Eq. ([5]) 
is defined implicitly, since the evolution operator Eo con- 
tains the solution g'(X, h). This cannot be avoided, since 
the Parisi differential equation ^ is nonlinear. We can, 
nevertheless use the implicit integral representation of 
the evolution operator to an approximate computation 
of the free energy and other physical quantities. The 
most straightforward way is to expand the T-ordered ex- 
ponential in powers of the exponent. This practically 



corresponds to a power-series expansion of the order- 
parameter function m(A). Such an approach becomes 
asymptotically exact near the de Almeida-Thouless in- 
stability line. We hence can analyze the critical behav- 
ior without the necessity to come over to truncated a 
model. If one finds an effective way how to systematically 
generates higher-order terms of such a power expansion, 
a rather accurate approximation in the entire spin-glass 
phase can be accomplished. Another method for resolv- 
ing the evolution operator is to approximate the order- 
parameter function with piece-wise constant functions. 
In this way we approximate the continuous scheme by a 
discrete one, resembling the discrete RSB from Eq. 

To conclude, we completed the Parisi formula for the 
free energy of the SK model so that it acquires the stan- 
dard form demanded by the fundamental principles of 
statistical mechanics. The derived free energy is a func- 
tion of two numerical order parameters q and X and a 
functional of an order-parameter function m(A) defined 
on interval [0, 1]. The physical values of these order pa- 
rameters are determined from stationarity equations for 
local extrema (maxima) of the free energy. The free en- 
ergy thus becomes a well defined generating functional 
from which all physical quantities can be derived via 
standard thermodynamic methods. There is no need to 
resort to the replica trick and a representation via math- 
ematical replicas to identify measurable quantities. The 
integral representation of the solution of the Parisi dif- 
ferential equation demonstrates that the thermodynamic 
state of the SK model is marginally stable and allows for 
explicit systematic and non-perturbative approximations 
of the thermodynamics of mean-field spin-glass models. 

Research on this problem was carried out within a 
project AVOZ10100520 of the Academy of Sciences of 
the Czech Republic. 
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